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^si I We derive a new maximal inequality for stationary sequences un- 

der a martingale- type condition introduced by Maxwell and Woodroofe 
[Ann. Probab. 28 (2000) 713-724]. Then, we apply it to establish the 
Donsker invariance principle for this class of stationary sequences. A 
Markov chain example is given in order to show the optimality of the 



Ph ' conditions imposed. 



1. Results. Let {Xi)i^z be a stationary sequence of centered random 
variables with finite second moment (i?[X^] < oo and £'[Xi] = 0). Denote 
by J-k the u-field generated by Xi with indices i < k, and define 
(N 

!>• ' no 

\0: Sn = y2Xi, Wn{t) = ^, 0<t<l, 

^Q I where [x] denotes the integer part of x. Finally, let W = {W{t) : < t < 

^^ ' 1} be a standard Brownian motion. In the sequel =^ denotes the weak 

Q . convergence and \\X\\ = ^JE{X'■^). 



Theorem 1.1. Assume that 



\^ . Then, {maxi<fc<,„ Sl/n : n > 1} is uniformly integrable and Wn{t) =^ ^yrjW{t), 

C^ I where rj is a nonnegative random variable with finite mean E[r]] = a^ and 
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2 M. PELIGRAD AND S. UTEV 

independent of {W{t);t>0}. Moreover, condition (1) allows to identify the 
variable r] from the existence of the following limit 

(2) lim ^('^"1^^ =r? mil, 

n— >oo fi 

where I is the invariant sigma field. In particular, liuin^ooE{S'^)/n = o"^. 

In the next theorem we show that, in its generahty, condition (1) is optimal 
in the fohowing sense. 

Theorem 1.2. For any nonnegative sequence a„ -^ Q, there exists a 
stationary ergodic discrete Markov chain {Yk)k>Q and a functional g such 
that Xi = g{Yi); i > 0, E[Xi] = 0, E[Xf] < oo and 

(3) y^ a„ ^ < oo but — ^ is not stochastically bounded. 

n=l V 

In the ergodic case, Theorem 1.1 improves upon the corresponding results 
of Maxwell and Woodroofe (2000) [see also Derriennic and Lin (2003) and 
Wu and Woodroofe (2002)]. 

Our method of proof is based on the martingale approximation originated 
in Gordin (1969). Rather then considering and analyzing a perturbed solu- 
tion of the Poisson equation, as it was suggested in Maxwell and Woodroofe 
(2000) [see also Liverani (1996)], we analyze small blocks and apply maxi- 
mal inequalities to show that the sums of variables in these blocks can be 
approximated by stationary martingale differences. 

In the proof of our key inequalities, we use a variety of techniques. The 
starting point is the diadic induction found to be useful in the analysis of 
/9-mixing sequences. This method goes back to Ibragimov (1975), and was 
further developed by many authors including Peligrad (1982), Shao (1989), 
Bradley and Utev (1994) and Peligrad and Utev (1997). The second tool is 
the modification of the Garsia (1965) telescoping sums approach to maximal 
inequalities as used by Peligrad (1999) and Dedecker and Rio (2000). Our 
maximal inequality, stated in Proposition 2.3, is new and has interest in 
itself. Finally, we use the subadditivity of the conditional sums of random 
variables. 

In order to show the optimality of our results, we construct an example 
which is motivated by the well-known counterexample stating that, in the 
general ergodic case, unlike the i.i.d. case (the Kolmogorov strong law of the 
large numbers), E\X\ = oo does not imply that the averages Sn/n diverge 
almost surely [see Halmos (1956), page 32; he has attributed this exam- 
ple to M. Gerstenhaber]. The discrete version of the example was probably 
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introduced in Chung [(I960), Markov chains, page 92]. For the modern de- 
velopment and connection with Pomeau-Manneville type 1 intermittency 
model, we mention Isola (1999) whose detailed analysis was inspirational. 

Theorem 1.1 is proved in Sections 2.1-2.4. Theorem 1.2 is proved in Sec- 
tions 3.1-3.3. 

2. Proof of Theorem 1. Throughout the section we will use the notation 



(4) Ar=Y: 

j=0 



"--' EiS^A^Fo) 



2i/2 
2.1. Analysis of second- order moments of partial sums. 



Proposition 2.1. Let n, r be integers such that 2^ ^ <n<2^' . Then 

(5) E{Sl)<7^[\\X,\\ + '^Ar]\ 

Assume J2^o '^~ \\E{S2j \^o)\\ < oo. Then, the following limit exists in Li: 

(6) rj := Jim ^^^ = E{Xl\l) + £ E[S,^iS,^^^- S2A^)] ^ 

j=0 

where I is the invariant sigma field. In particular, 

3=0 ^'^ 

Proof. The last statement is an immediate consequence of (6). In order 
to prove (5), we shall use an induction argument. It is easy to see that (5) 
is true for r = and n = 1. Assume (5) holds for all n < 2^~^ . Fix n, 2^~^ < 
n < 2^. Starting with Sn = S'„_2'--i + Sn — 5'„_2r-i and using the Cauchy- 
Schwarz inequality and stationarity, we derive 

ll^nll < ||'S'„„2'— 1|| +l|5'2'--i|| + 2||S'„„2'— i||||-^('S'2'— i|-^o)||- 



Now, by induction assumption, since ||£'(5'2r-i|.7i))|| = 2''' ^'/'^{/S.r - 
and 4(n - 2''"^) 2''"^ < n^, we obtain 

\\Sn\? <{n- 2^^-^)[||Xi|| + iA,_i]2 + 2^-i[||Xi|| + lA,_i]2 

+ 2(n - 2'-^i)i/2[||Xi|| + iA,_i]2(^-i)/2(A, - A,_i) 

< n[\\X^ II + iA^_i + ^(A^ - A^„i)]^ = n[||X, || + ^A^]' 

This estabhshes (5). 



ir-i;, 
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To prove (6) for the subsequence n = 2*^, we use the notation Ej{Y) = 
E(Y\I) and ||5^||/ = \/E{Y''^\I) for the corresponding norm. By recurrence, 
we can easily estabhsh the representation 



EiyS2r) — 2 Ej[X ) + / 2 i5//[<S2r-i (1S21 — i+l — D-^r-i 

1 = 1 



r—1 

2J 
We observe that 

E[S2j{S2J+i - S2j)\I] = E{E[S2j{S2j+i - S2j)\^2A\^} 

[see, e.g.. Proposition (2.2) in Bradley (2002), page 54]. Thus, by the Jensen 
inequality, 

E\E[S2dS2.+i - S2j)\I]\ < E\E[S2j{S2,+i - S2,)\J'2A\ 

so that the Cauchy-Schwarz inequality and stationarity imply 

E\E[S2j{S2j+i - S2,)\I]\ < \\S2ME{S2A^o)\\. 

In addition, by the first part of the proposition and the summability of the 
series in the right-hand side of (4), we obtain 

E{S2j\^o) 



y^ ll'S'2j||||£^('S'2j|-^o)|| ^(jY^ 

j=0 ^ j=0 



< 00, 



2i/2 
which proves the convergence in Li of the series 

E{X!\I) + £ mS2.iS2.^^-S2.m ^ ^_ 

This relation and (7) show that the convergence in (6) holds along the sub- 
sequence n = 2''' , that is, 

r— >oo 2 

To treat the whole sequence Sn^ for 1 < n < 2^, we start with the binary 
expansion 

r-l 

n = 2_] 2 Cfc where aj._i = 1 and a^ G {0, 1}. 

A:=0 

Then, we apply the following representation: 

r-l %■ j 

Sn = ^ T2J aj where T2J = ^ Xi,nj = ^2''ak,n_i=Q. 

j=0 i=nj_i+l fc=0 
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Clearly, for aj = 0, T2J = 0. For aj = 1, the conditional distribution of T2J 
given I is equally distributed as the conditional distribution of 823 given I. 
To prove (6), we start with the representation 

E[Sl\I]= rj2^iE[Si^\^V\ + ( E a^a,E[T2.T2j\I]\=In + Jn. 
By the above convergence, i?[S'2j |X]/2-' — > r/, which implies the convergence 



In 

n 



in Li 



It remains to prove that \^ — > 0. Let i < j <r. Then, as before, 

E\E[T2^T2Al]\<E\E[T2.E{T2j\J^nJ]\ < ||52» II 11^(52. |^o)|| 



< C2*/2^ 



E{S23\J^o) 



2i/2 



and, thus. 



r-2 



E\Jn\<2 Y. E\E[T2^T2J\I]\<2C^/^J2'^'^^ Y. 
l=i<j<r—l i=l j=i+l 

which implies E\Jn\/n^ because 

E{S2j\J^o 



E{S2j\To) 



2i/2 



E 



2i/2 



as i — > 00. 



D 



2.2. Maximal inequalities. We start by establishing first an auxiliary 
lemma: 



Lemma 2.2. Let (yi)i<i<n be a random vector of square integrahle ran- 
dom variables such that for each i, 1 <i <n, Yi is measurable with respect 
to Ti = a{Xj, j <i), where (Xi) is a stationary sequence introduced before. 
Let n<2^ . If for all 1 < a<b<n, and a positive constant C, 



eI J2yA <C{b-a + l) 



then 



. l=a 



n-1 



EY,Y,iSn-Si) 



1=1 



< ^CnAr. 



Proof. We shall prove this lemma by induction. It is easy to see the 
result of this lemma is true for n = 2. Assume the lemma holds for all n < 
2^~^ . Fix now n, 2^~^ < n < 2*", and begin by writing 

n-l n-2'— 1-1 

J2Y,iSn-Sl)= Y. Y.iSn-2r-l - Si) 

1=1 1=1 
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+ Y. y,iSn-si)+ Y. y^iSn-s^_,r-.). 

i=n-2'— 1 1=1 

= h + l2 + h. 

By using the Cauchy-Schwarz inequality, along with the conditions of this 
lemma and stationarity, we easily obtain 

\Eh\ < C[2'-\n - 2^~i)]i/2(^^ _ ^^_^) < ^Cn[Ar - A^_i]. 

By the induction assumption, \EIi\ < ^C{n — 2'''^^) Aj—i and I-B/2I < \CT'~^ x 
Ar_i, so 

\Eh\ + 1^/2! + \Eh\ < ^CnAr-i + ^Cn[Ar - A,._i] = ^CnA,., 

proving the lemma. D 

We are ready to state and prove our key maximal inequality. 

Proposition 2.3. Let {Xi :i E Z} be a stationary sequence of random 
variables. Let n, r be integers such that 2^~^ < n < 2^. Then we have 



E 



max 5,- 

l<j<n. 



<n(2||Xi|| + (1 + ^/2 )A^)^ 



1 



(8) 



Proof. Denote by 

We first prove that, for any positive integer n, 

<n[2Kl^^Ar + 4[\\Xi\\ + '^Arf]. 



In — max \Si\ and K^ = max —E 

l<i<n ^<j<rn j 



max 5,- 

l<i<J 



E 



max S,: 

l<i<n 



By the fact that Ki is nondecreasing in /, from (8), we derive 

K„<2Ky2A,+4[||Xl||+iA,]^ 

1 /2 / — 

which implies Kj < 2||Xi|| + (1 + v2)Ar, hence, the result. 
To prove (8), we denote by ^o = 0, 



and 



M- 



max S^ = max(0. Si , . . . , 5„) 

l<j<n ■' 



max {—S, ) = max(0, —Si, . . . , —Sn) 

l<j<n ■' 



We shall use the following simplified version of an interesting inequality in 
Dedecker and Rio (2000) [see (3.4) in Dedecker and Rio (2000) or (3.5) in 
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Rio (2000)], which was obtained by using Garsia's (1965) telescoping sum 
approach to the maximal inequality 



(9) 



(M+)2<4(5+)2-4 5]M+„iXfc. 
fc=i 



By adding to this relation the similar one for M„ , we obtain 

n 
k=l 

We now write X^ = {Sn — Sk^i) — (5'„ — S^) and derive 

n.-l 

(10) iMnf<A{Sn)^-AY.DkiSn-Sk), 



k=l 



where Dj, = (M+ - M+_i) - (M," 
It is easy to see that 



M. 



k-lJ- 



k=a+l 



<max[(M+-M+),(M,--M-)] 



< max \Si — Sa\- 

a<i<b 



Taking the expectation, we get, by stationarity, 

2 



E{ V Dk] <e( max 5^ = (6 - a)i^,„„ < (6 - a)A'„. 

\k^+l J V<^<b-a J 



1/2 

Next, by Lemma 2.2 applied with Y^ = D^ for k>l, C = Kn , we obtain 



n-l 
E } ^ Dk{Sn — Sk) 
k=l 



By substituting this estimate in (10) together with (5) on £'(5^), we 
obtain (8) and, hence, the proposition. D 

Remark 2.4. The inequality in Proposition 2.3 is an extension of the 
Doob maximal inequality for martingales, giving also an alternative proof 
of this famous theorem. Notice that, for the martingale case, our inequality 
gives the same constant as in the Doob inequality, a constant that cannot 
be improved. A natural question that arises is the optimality of the constant 
in front of A^ and further study is needed to determine the best constants 
in this inequality. 
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2.3. Analysis of certain series involving conditional sums. 
(a) Key result. Let X = {Xi)i^z be a stationary sequence of random vari- 
ables with finite second moment. Denote by 

n 

Sn=Y.Xi, Vn = Vn{X) = \\E{Sn\J'o)\\, 

i=l 

where as before, J-k is the fj-field generated by Xi with indices i <k. 

The main condition (1) of Theorem 1.1 is J^^n/n^ < oo. On the other 
hand, various inequahties derived in Sections 2.1 and 2.2 have used the 
condition X]^''/^'"'^ < oo. In this section we show that these conditions 
are equivalent and, in addition, we prove the following proposition, which is 
useful in establishing the martingale approximation in Theorem 1.1. 



Proposition 2.5. Under condition (1), 



\\E{Sm\J^O 



and —== y 



m \irri . 



-E'(5'm2i|-^0 



2J/2 



as m ^f oo. 



Proof. In order to prove this result, we shall analyze in Lemma 2.6 the 
conditional variance of sums and then, in Lemma 2.7, some related series. 
By Lemma 2.6, the sequence Vm = ||-£'(5'm|-^o)|| is subadditive. Then, we 
have only to apply Lemma 2.8 to conclude the proof of this proposition. D 

(b) Conditional variances of sums form a subadditive sequence. The start- 
ing point of our analysis is the following simple observation. 

Lemma 2.6. Vn is a subadditive sequence. 

Proof. First, since for all n, J-'-n C J^q, we observe that 

E[E{Sk\T.n)f < E[E{Sk\To)f = ||i?(5fc| J-o)f = V^ 
Hence, by stationarity. 



\\EiSi+j - Si\J^o)\\ = ^E[E{S,\J'^i)Y < Vy 
Thus, 

y,+,- = \\E{S^ + [5,+,- - Si]\TQ)\\ < \\EiS,\J^o)\\ + \\EiS,+j - 5,|^o)|| 

(c) Analysis of certain series for subadditive sequences. Let V^ be a non- 
negative subadditive sequence. For a p> 1, define 

-^ 2J(p-i) ^ nP ^ l<i<n 

j=0 n=l n=l 
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D 

The following lemma is a crucial step in deriving the result in Proposi- 
tion 2.5. 

Lemma 2.7. There exists two positive absolute constants Cp and Kp 
such that 

CpI<J<W< Kpl. 
Proof. We shall start with the following simple representation: 

oo oo 2'"+i-l 

W ='S^ n~^ max Vi = T^ y^ n~^ max Vi. 

^ l<j<n ^ ^, l<i<n 

n=l r=0 n=2^ 

Then, by the subadditivity of the sequence {Vn;n > 0}, for i < n < 2'"+^, 

r r 

Vi < y V2] SO that max Vi < } V2J , 

r, l<i<n ■^ 

which implies 

00 r 00 00 00 

r=0 fe=0 fc=0 r=fc fe=0 

= Kpl, 

where Kp = ._2-(p-i) • The last inequality is therefore proved. 

The inequality J < M^ is straightforward. Now, we need the following 
simple combinatorial property. Define 

An = {^ < i < N -.Vi > VAr/2} and denote by \A\ the cardinal of a set A. 

Property. I^ItvI >N/2, that is, An contains at least N/2 elements. 

Proof. To prove it, we denote by Dn = {1, . . . , iV} and fix 1 < z < iV. 
Observe that if i £ A^ = Dn — An, then N — i £ An because 

VN-i >VN-Vi>VN- Vn/2 > Vn/2. 

Thus, An^N-A% and so A^ = \Dn\ = \An\ + \Aj^\ < 2\An\ and the prop- 
erty is proved. D 

Now, in order to continue the proof of Lemma 2.7, we write 

r=0\ n=4'- / r=0 \ n=A^ / 
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We are going to apply the above property with N = 4^+^ . Define 

a = {n G {4^..., 4^+1 -l}:K>FW2}=^^n{4^..., 4^+1-1}. 
Clearly, 

\Cr\ > |{4^ . . . ,4^+1 - 1}| - l^l^l = 4^+1 - 4- - \A%\ 
and, applying the above property, we obtain 

lai > 4r+^ - 4^ - (4^+^ - l)/2 > 4*^+1 - 4'' - 4''+V2 = 4^ 
Thus, 



r=C 

which implies 



r=0 r=0 r=l 



r=0 r=l 

Then, by subadditivity, V22r+i < 2V22r , so that 

CO ry CO n 

P-=T. 2-(-+^)(-^V22... < ^ E 2-(-)(- ^22. = ^Q 

r=0 r=0 

and, as a consequence, 

Z^ 22'-(p-i) ^ ^ 2(2^+i)(p-i) ^ ^ ^ - ^ I 2(p-i) ^ M '^' 

r=0 r=0 

and the proof of Lemma 2.7 is complete. D 

Lemma 2.8. Assume that E^i K"-"^^^ < oo. Then, 

/n particular, Vm/^/m — > as m ^^ oo. 



Proof. By rewriting Gm, we obtain 

oo m2*^+i-l oo m2'=+i-l 

l<j<n 



fc=0 n=m2'<= k=0 n=m2'' 



= 2^/2 y n"3/2 max Vi, 

^^ l<i<n ' 

n=m — — 

which proves that Gm ^ as m — > oo by Lemma 2.7. D 
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2.4. Martingale approximation and the proof of Theorem 1. Let tti be a 
fixed integer and k = [n/m] , where, as before, [x] denotes the integer part 
of X. We start the proof by dividing the variables in blocks of size m and 
making the sums in each block 



v{m) -1/2 



E 



X 



J' 



i>l. 



j={i—l)m+l 

Then we construct the martingale 

k 



M, 



(m) 



E(Xri^^O), i^Z, 



i=l 



.(m) 



.(m) 



where J-j. denotes the cr-field generated by X^ with indices i <k. 

Notice that M^™ is a stationary martingale and, therefore, by the classical 
invariance principle for martingales, we derive 

where r/'*"^ is the following limit (both in Li and almost surely): 



Jm) 



ii-rE(^r-^(^ri^-7)) 



(m) I ^(m)xs2 



i=l 



In order to prove the invariance principle for ^5[„(], together with the 

uniform integrability of the sequence maxi<fc<„ S'^/n, by the Doob maximal 
inequality and Theorem 4.2 in Billingsley (1968), we have only to establish 
that 



(11) 


||y^(m)_^||^0 


as m ^ oo 


and 






(12) 


hm hm 


sup 
o<t<i 




Vk 1^*1 



0. 



Notice first that by the convergence in Proposition 2.5, 

lim —E[E(Sm\:Fo)f = 0. 
On the other hand, by the ergodic theorem (both almost surely and in Li), 



1 



.(m.)-)2 

where X is the c-field of invariant sets. 



1=1 



1 1 "■ 

— lim -V(S'iH 

777, n-»oo 72, ■^ 
t=l 



Si 



2 _ E[S^\I] 



m 



12 
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Therefore, by Proposition 2.1, we obtain the following convergence in Li: 

E{Sl\l) 



hm 77*^™' = lim 



v. 



which implies (11). 

To prove (12), we first notice that 



sup 

0<i<l 



1 



n 



S\nt] 



1 



'km 



=5, 



nt] 



< 1 



'km 



1 



max IS*,- 
n l<j<n 



By taking into account Proposition 2.3 and the fact that lim„_>oo(l — TT") ~ 
0, the right-hand side of the above inequality tends to 0. Therefore, we have 
only to estimate 

1 



sup 

0<t<l 



< 



'km, 
1 



'km, 



[nt] 

sup V Xi 

0<t<l 



i=[kt]m+l 

which leads to the estimate 



1 

Vk 



sup 

0<t<l 



[kt] 



(m) I q^ini) N 



Y.E{xr^rn 



1=1 



1 



sup 

0<t<l 



< 



y/km, 
3m 



-Su 



1 



nt] 



M, 



(m) 



Vk ^"'^ 



ykm 
Since for every e > 0, 



max Xi 

l<i<n 



+ 



y/k 



max 



4=1 



Y.E{xt\:F\ 



(m) I '^■{m) N 



Em3^Xf<e + Y,Xfl{\Xi\>e) 



l<i<n 



i=l 



by stationarity, for any fix m, lim„^oo3m|| maxi<j<„Xj||/vAJm = 0. 
On the other hand, by Propositions 2.3 and 2.5, we derive 



1 

y/k 



max 

i<j<fc 



(m) I ^(m) N 



j:Eixr\m 



i=l 



/m Jm ^^ 



-E^('S'm2i|-^o) 



2i/2 







as TTi ^ oo, uniformly in n, which completes the proof of Theorem 1.1. 
3. Proof of Theorem 2. 
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3.1. The countable Markov chain and its preliminary analysis. Let {Yk;k > 
0} be a discrete Markov chain with the state space Z'^ and transition ma- 
trix P = {pij) given by Pk{k-i) = 1 for A; > 1 and pj =po(j-i) = P{t = j), 
j = 1,2, . . . (i.e., whenever the chain hits 0, Yj = 0, it then regenerates with 
the probability pj). Whenpi, p2 > 0, and, in addition, pn^ > along Uj — > oo, 
the chain is irreducible and aperiodic. The stationary distribution exists if 
and only if E[t] < cxd and it is given by 

oo 

^i = '^0 '^ Pi, J = 1,2,..., 
i=j+i 

where ttq = 1/E[t]. 

Let us consider now an arbitrary nonnegative sequence o^ — > as in our 
Theorem 1.2. Notice that, without loss of generality, it is enough to assume 
that Un is a strictly decreasing sequence of real positive numbers. 

The choice of pj further depends on this arbitrary nonnegative sequence 
ttn- First, we define a sequence {uk;k = 1,2,...} of positive integers such 
that 

ui = 1, U2 = 2, Uk + 1 < Uk+i for /c > 3 and 

(13) 

at < k for t>Uk- 

Then, for i > 1, we take 

c/u^, if i = Uj for some j >l. 



^' \o, ' iii^uj for ah j>l, 

that is, for each positive integer j > 1, Puj = c/uj and pi = for Uj < i < 

Uj + l- 

Clearly, 

(14) E[t] < oo but E[t^] = oo. 

As a functional g, we take I(^x=o) ~ "^o, where ttq = Pn{Yo = 0) under the 
stationary distribution denoted by P^^ {En denotes the expectations for the 
process started with the stationary distribution). The stationary sequence 
is defined by 

n n 

Xj = I(Yj=o) - ^0 so that Sn = ^Xj = ^ -^(^,=0) - nTTQ. 

i=i i=i 

By Pk and E^, we denote the probability and the expectation operator when 
the Markov chain is started at k, that is, P{Yq = k) = 1. Let 

i/ = min{m> l:ym = 0}, An = EQ[Sn], x Ay = inm{x,y). 



14 
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Proposition 3.1. 

Vn = \\E{Sn\Yo)\\ <||z^An||+ max \A,\ 

l<i<n 

^ ^n I 'Jni 
1 II II 9 \-~voo 9 

where \\x\\ =l^f^^QXp:k■ 
VKOO¥. We first notice that |5,„| < n and Pa:(^ = ^) = Ij so that, condi- 
tionally on Yq = ^ (with < fc < n) , 

Ek{Sn)=Ek{Sk)+Ek{Sn-Sk). 

The first term is bounded by k and the second term is equal to -Eo(5'n-fc+i) 
since Y^ = 0. Thus, 



\Ek{Sn)\ <k^n + \An-k+l\ 



D 



3.2. Proving that Ylcin\\E{Sn\YQ)\\n ^/^ < oo. By Proposition 3.1, it is 
enough to prove that 



(15) 



^ a„/„/n2/2 + ^ anJn/n^'"^ < oo. 



n=l 



n=l 



The first sum is easily treated by a straightforward analysis. Indeed, to 
analyze / = ^anln/n^ , we first notice that, for nt_i < j, 

oo 

Therefore, we write, for u^ <n< u^+i, 

n oo 

j=l j=n+l 



< 



Lt=l \j=wt_i+l / 



E ^"-. 



C3 



?ife+l 



<C2 E-r^ E^"i + 

Next, write 



oo / Ut > 

-^ E E -. 

t=k + l \j=Ut-l + l / 

1 



E n^-^n' E f 



^j='"fc+l 



i=fc+l 



^it 



«fe+l 



oo T oo "•fc + i 7- oo -| •^ft + i 

n=l fc=l?i=Mfc+l A:=l n=itfcH-l 
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<V^E^ E --^/^ + V^E^^ E 1 






+ V^E^=^i:2 E " ''^<oo- 



To prove that the second sum is finite, we need to analyze An, which 
satisfies the renewal equation 

n-l 
An = EolSnAiy] + 2^ An-jPj- 

i=i 

Unlike Isola (1999), we use probabilistic arguments to analyze this renewal 
equation. 
We define 

ro = 0, Tk = mm{t>Tk-i:Yt = 0}, Tk=Tk-Tk-i, k=l,2,.... 

Then, {tj} are independent variables equally distributed as r. [See, e.g., 
Breiman (1968), page 146.] Let ^j = 1 — ttqTj and introduce the stopping 
time 

i^n = min{j > 1 : Tj > n}. 
Clearly, St^. = J2j=iCj-: ^o[Ci] = 0, f„ < n and, thus, by the Wald identity. 



5j 



E^. 



0. 



Eo[St,J = E 

Hence, since \Sa — Sb\ < |a — 6|, by the definition of A„, we obtain 

\An\ = \Eo[St^^ - Sn]\ < Eo[t,J < E^ 
Let us denote by 



max To 

l<i<n 



Then, 



Mr, = max Tj. 

l<i<n 



J„ = max \Ai\ < E[Mn]. 

l<i<n 



To analyze E[Mn], we notice that 



t=l 
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and 

P{Mn = Ut) < mm(l, nP(T = Ut)) < cimm(l,ri/uj). 



Fix n, Uk <n < u^+i- Notice first that, for t < k — 1, we fiave ut < Uk-i < 

UfJ < n-^'^. Also, J2'j^k+i 1/""^ — cs/tife+i and, tlius, splitting the sum into 
three parts according to t: t <k — l, t = k and t > A; + 1, we obtain the bound 



E[Mn] < cAn^/'^ + -^ + Uk min(l, n/ul) ) . 
V Uk+i J 

Finally, by the construction of n„ and its relation to a„, we derive 

n=l n=l k=l ^~^^ n=itfc+l 

2 
OO -, -, "fe OO , Mfe + 1 

+ ^7E^- E ^"'^'+C8E^^^ E ^"'^' 

< OO, 

proving (15). 

3.3. Stochastic unboundedness of Snj \pri and the proof of Theorem 2. 
We proceed by contradiction; that is, we assume that 

{Sn/\'^',n > 1} is stochastically bounded 

and show that Et'^ < oo, which is in contradiction with (14). 

Let {tj} be independent variables equally distributed as r. Define 

Tk=Ti-\ h Tfc, r]n= max{i > 1 : Tj < n}, 

T{i,n] =r„ -Ti, rjniO = max{z > l:^ + r(l,f] < n} 

(where maxjg0 Oj = 0). Then, 5^ = rjn{i^) — na, where a = 1/E[ti] = ttq. 

The following proposition will provide a slightly more general result which 
has interest in itself. 

Proposition 3.2. Assume that, for a nonnegative integer valued vari- 
able s,, 

(16) < — — -^ ;n > 1 f is stochastically bounded. 

Then, E[Tf] < cx). 
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Proof. First, let r/^ be a copy of the renewal process {r]n : n > 1} which 
does not depend on ^. Then, r]n{£,) is equally distributed as rj'n-f and so, 
any finite number of renewals do not affect the stochastic boundedness of 
the normalized renewal processes. As a consequence, condition (16) implies 
that 

P{[an - ^/^M] <r]n< [an + ^/nM]) > 1 - em, 

where em — > as M — > oo . 

Next, we apply the standard relationship {rjn > k} = {Tk < n}, yielding 

P{[an - VnM] < rj,, < [an + ^/nM]) = P{Ty^n-^M] < n, T[^n+y^M] > n) 

= P{Tl <n,TR>n) = I>l- em, 

where 

L = L[n, M] = [an - ^/nM] , R = R[n,M] = [an+ y/nM] . 

Now, we take k = R — L. Since T{i,n] = Tn — Ti is equally distributed 
as Tn-i, we can write 

I = P{TL<n,TL+T{L,R]>n) 

= P{Tl <n-kN,TL+ T{L, R] > n) 

+ P{n -kN<TL<n,TL + T{L, R] > n) 

< P{T{L, R] > kN) + P{n -kN <TL<n) 

= P{Tk > kN) + P{n -kN <Tl< n). 

By the law of the large numbers, 

P{n/k >N)< 5m, 

where Jat — > as A^ — > oo. Thus, 

P{n -kN <TL<n)>l-EM-5N- 
Since 2y/nM -l<k< 2y/nM + 1, we derive 

P{[Tl - n[l^ < (2Af + 1)A) > 1 - em - 6n- 

Now we use the symmetrization argument. We consider an independent copy 
of {tj}, namely, {t'A and denote by T^. = r( H h t^ , T^ = T^ — T^.. Clearly, 

P{[n[/V^ > 2(2M + 1)A) < EM + 6n. 
Here 

lim L{n,M)/n = a. 
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By standards arguments involving an application of the Levy maximal in- 
equality for sums of symmetric independent random variables, we easily de- 
rive that the sequence {T^/^/n} is stochastically bounded. By Theorem 3 in 
Esseen and Janson (1985), the fact that {T^/^/n} is stochastically bounded 
implies E{ti - t{)^ < oo. Thus, Eti < oo. D 

Proof of Theorem 1.2. By combining Proposition 3.1 with the bound (15), 
we obtain the first part of (3). To prove the second part, we proceed by ab- 
surd and notice that if {Sn/y/n} is stochastically bounded, then by Propo- 
sition 3.2, E[t'^] < oo, which is in contradiction with (14). 

The proof of Theorem 1.2 is complete. D 

Acknowledgments. The authors would like to express their gratitude to 
the referee whose suggestions led to significant simplification of the proofs, 
contributing in this way to the improvement of the presentation of this paper. 
We would also want to thank to Wei Biao Wu for showing us an interesting 
alternative way to improve on the constants in our former version of this 
paper. His comments led us to refine our proofs to further improve the 
constants in the maximal inequality. 

REFERENCES 

BiLLlNGSLEY, P. (1968). Convergence of Probability Measures. Wiley, New York. 

MR233396 
Bradley, R. C. (2002). Introduction to strong mixing conditions, 1. Technical report, 

Dept. Mathematics, Indiana Univ., Bloomington. MR1979967 
Bradley, R. C. and Utev, S. (1994). On second order properties of mixing random 

sequences and random fields. In Probability Theory Mathematical Statistics (B. Grige- 

lionis, J. Kubilius, H. Pragarauskas and V. Statulyavichus, eds.) MR1649574 99-120. 

VSP/TEV, Vilnius. 
Breiman, L. (1968). Probability. Addison-Wesley, Reading, MA. MR229267 
Chung, K. L. (1960). Markov Chains with Stationary Transition Probabilities. Springer, 

Berlin. MRl 16388 
Dedecker, J. and Rio, E. (2000). On the functional central limit theorem for stationary 

processes. Ann. Inst. H. Pomcare Probab. Statist. 36 1-34. MR1743095 
Derriennic, Y. and Lin, M. (2003). The central limit theorem for Markov chains started 

at a point. Probab. Theory Related Fields 125 73-76. MR1952457 
Esseen, C. G. and Janson, S. (1985). On moment conditions for normed sums of in- 
dependent variables and martingale differences. Stochastic Process. Appl. 19 173-182. 

MR780729 
Garsia, a. M. (1965). A simple proof of E. Hopf's maximal ergodic theorem. J. Math. 

Mech. 14 381-382. MR209440 
GORDIN, M. I. (1969). The central limit theorem for stationary processes. Soviet. Math. 

Dokl. 10 1174-1176. MR251785 
Halmos, p. R. (1956). Lectures on Ergodic Theory. MR97489 The Mathematical Society 

of Japan, Tokyo. 



A NEW MAXIMAL INEQUALITY 19 

Ibragimov, I. A. (1975). A note on the central limit theorem for dependent variables. 
Theory Probab. Appl. 20 135-140. MR362448 

ISOLA, S. (1999). Renewal sequences and intermittency. J. Statist. Phys. 24 263-280. 
MR1733472 

LiVERANi, C. (1996). Central limit theorem for deterministic systems. In International 
Conference on Dynamical Systems (F. Ledrappier, J. Lewowicz and S. Newhouse, eds.) 
362 56-75. Longman, Harfow. MR1460797 

Maxwell, M. and Woodroofe, M. (2000). Central limit theorems for additive function- 
al of Markov chains. Ann. Probab. 28 713-724. MR1782272 

Peligrad, M. (1982). Invariance principle for mixing sequences of random variables. Ann. 
Probab. 10 968-981. MR672297 

Peligrad, M. (1999). Convergence of stopped sums of weakly dependent random vari- 
ables. Electron. J. Probab. 4 1-13. MR1692676 

Peligrad, M. and Utev, S. (1997). Central limit theorem for linear processes. Ann. 
Probab. 25 443-456. MR1428516 

RiO, E. (2000). Theorie Asymptotique des Processus Aleatoires Faiblement Dependants. 
Springer, Berlin. MR2117923 

Shao, Q. (1989). On the invariance principle for stationary p-mixing sequences of random 
variables. Chinese Ann. Math. lOB 427-433. MR1038376 

Wu, B. W. and Woodroofe, M. (2002). Martingale approximation for sums of stationary 
processes. Ann. Probab. 32 1674-1690. 

Department of Mathematical Sciences School of Mathematical Sciences 

University of Cincinnati University of Nottingham 

P.O. Box 210025 Nottingham, NG7 2RD 

Cincinnati, Ohio 45221-0025 England 

USA E-MAIL: pnizsu@gwmail.nottinghani.ac.uk 

E-MAIL: peligrin@math.uc.odu 



